Remarks on a monotone Markov chain
نویسندگان
چکیده
منابع مشابه
Relative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملRemarks on Non - Markov Processes
It is emphasized that non-Markovian processes, which occur for instance in the case of colored noise, cannot be considered merely as corrections to the class of Markov processes but require special treatment. Many familiar concepts, such as rst-passage times, no longer apply and need be reconsidered. Several methods of dealing with non-Markov processes are discussed. As an example a recent appl...
متن کاملRemarks on filtering of semi-markov data
This paper tries to give some insight about relationships between Viterbi and Forward-backward algorithm (used in the context of Hidden Markov Models) on one hand and Kalman ltering and Rauch-Tung-Striebel smoothing on the other. We give an unifying view which shows how those algorithms are related and give an example of an hybrid system which can be ltered through a mixed algorithm. Remarques ...
متن کاملFastest Mixing Markov Chain on a Path
Simulation using Markov chain Monte Carlo is a mainstay of scientific computing; see, e.g., [4, 5] for pointers to the literature. Thus the analysis and design of fast mixing Markov chains, with given stationary distribution, has become a research area. In [2], we show how to numerically find the fastest mixing Markov chain (i.e., the one with smallest secondlargest eigenvalue modulus) on a giv...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Applied Mathematics and Simulation
سال: 1987
ISSN: 0893-5688
DOI: 10.1155/s1048953388000103